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1.  Introduction 


We  consider  the  general  linear  model 


(1.1) 


yi  =  Ti  +  zi/ao  ^  = 


where 


0.2) 


Here  the  0^  are  unknown  parameters,  the  c.^  arc  known  constants,  the  z^  are 
independent  and  identically  distributed  with  common  distribution  function  F 
(symmetric  about  zero),  and  is  a  constant  to  be  chosen  later.  Huber  (1973) 
proposed  estimating  0  by  solving  the  system  of  equations 


(1.3) 


(1.4) 


Ij  <Ko(yi  -  ti(0)))cij  =0  (j  =  l,...,p) 
Ii(«^2(o(yi  -  t.(B)))  -  M  =  0  , 


where 


tL(P,) 


S  C..0. 
j»l  ^  -1 


(the  expectation  being  taken  under  the  standard  normal  distribution)  and  ip  i s  a 

T  -IT 

monotone  nondecreasing  function,  l.ct  C  *  (c^),  r  =  C(C  C)  C  be  the 

projection  matrix,  and  c  be  the  maximum  diagonal  clement  of  F. 

Huber  (1973)  considers  <i  fixed  and  known  (o  =  1)  so  that  one  only  need 

2  3 

solve  (1.3).  He  proves  that  if  cp  -*■  0  as  n  -*•  °°  (which  implies  p  /n  ->  0) 
and  if  ip  is  bounded  with  two  continuous  bounded  derivatives,  then  all  estimates 
of  the  form  ni  »  pj  (7\  af  =  1)  are  asynf»totoically  normal.  It  is 


I 


2 


routine  to  extend  his  results  to  the  system  (1.3),  (1.4)  (see  below).  The 
smoothness  conditions  on  are  not  satisfied  for  three  of  the  most  coimonly 
used  functions,  namely 

1*1  <  c 

1*1  I  c 

0  <  x  <  a 

a  <_  x  <  b 

b  <  x  <  c 

x  ^  c 

0  <  x  <  TIC 
x  ire  . 

In  this  note  we  weaken  Huber's  conditions  to  include  the  coninon  \|r  functions, 
at  the  cost  of  slightly  strengthened  conditions  on  the  rate  of  growth  of  p, 
the  dimension  of  the  problem.  The  results  have  been  applied  by  Carroll  and 
Ruppert  (1979)  to  the  probe lm  of  testing  for  heteroscedasticity  (Bickel  (1978)). 

As  in  Huber's  proof,  we  assune  C'C  *  I.  Because  of  the  invariance  of  the 
problem,  we  can  take  =0  (j  *  l,...,p)  and  oQ  ■  1,  primarily  to  simplify 

notation. 


Andrew's  f miction 

>p(x)  =  -ip(-x)  *  sine(x/c) 
*  0 


Huber's  function 
i|/(x)  *  x 

*  c  sign(x) 


2.  Notation,  Assumptions  and  Main  Results 


Let  a  be  an  arbitrary  (p  x  l)  vector  for  which  Z  a 


Define  for 


while 


Our  estimates  are  solutions  to  $  (3,0)  =  0  (j 
approximate  (£,o)  by  (£,o)  which  solves  ^(£,0)  = 
We  make  the  following  assuiqitions. 


(2.1j  is  odd,  bounded,  and  constant  outside  a  finite  interval 


'!'  is  Lipschitz  of  order  one  and  has  two  continuous  bounded  derivatives 
except  at  a  finite  lumber  of  points,  which  we  take  without  loss  as  ±c. 


(2.5)  F  is  synmctric  about  zero 


(2.4)  F  is  Lipschitz  in  neighborhoods  of  +c 


Theorem  1.  If  (2.1)  -  (2.5)  hold  and,  in  addit  ion,  there  is  a  sequence  a  -*  0 
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(2.6)  (ep/a‘)  -  0,  (enaj  >  0  , 

then  there  is  a  sequence  of  solutions  to  (1.3)  -  (1.4)  such  that 

(2.7)  ||(3,  (npr  (o  -  D)  |  |  =  0p(p). 

If  in  addition 

(2.8)  (rp2/a^)  ->•  0,  (cnpan»  >  0  , 
then 

(2.9)  ||(8,  (np)'s  (3  -  1))  -  (3,  (up)*’  (3  -  1))||  P  0  . 

Thus,  (2.1)  -  (2.5)  and  (2.8)  imply  that  all  csimtatcs  of  the  form 
a  =  Ij=1  «j  Bj  (I  |a|  l2  -  1)  are  asymptotically  normal. 

Remark:  The  result  (2.7)  is  the  starting  point  in  constructing  robust  tests 
for  heterosccdasticity  (Bickel  (1978),  Carroll  and  Rtippert  (1979));  it  implies 
the  crucial  assumption  T  of  Rickel's  Theorem  3.1.  for  balanced  designs 

(c  =  p/n),  assumption  (2.6)  is  satisfied  by  choosing  a  =  p  +  for  small 

4+  ■*v  2 

y  >  0,  which  then  requires  p  “'/n  •*  0,  as  compared  to  Huber's  condition  p  /n  >  0 

when  $  has  two  derivatives. 

3.  Proof  s 

Proposition  1.  Suppose  that  (2.1)  -  (2.5)  hold,  that  &  has  two  bounded  contin¬ 
uous  derivatives,  and  that  cp  -*•  0.  Then  on  the  set 

||(3,  (i>n)'5  (a  -  1))||2  <  Kp, 

the  following  hold: 


i 


-JR!.1 1  » 


(3.1) 

(3.2) 


INM)  -  ne.o)M  =  yop2n  , 

I  1 4>(B,o)  -  (0,  (up)**  (a  -  1))||  =  0  (p?i  +  Ct-p2)*5) 


Proof  of  Proposition  1.  By  a  Taylor  scries  expansion, 

(3.3)  |  f  a.(*.(Bfa)  -  4'.(0,o))  ♦  (o  -  1)  J  s.y.  *'(y.)/E  f(y,) 
j-1  J  J  J  i=l  1  1  1  1 

-a  J  s.  t.(e)(ip’(y.)  -  R  ♦’(y^i/E  ip'(y1) 

"  'An' 

n 

<  |o  -  i|  |J  s.  ti(a)yi  «|/'((i  +  n2i)yi)/R  CyL) | 

+  o“  |  j  s.  t2(0)  if/" (a  y.  ♦  nu)/E  £yx) |  . 

2 

On  the  set  ||B||  <_  Kp,  |o  -  1 1  <■  -2,  ||a||  =  l,  Mulier  shows  that  the  second 

term  on  the  r.h.s.  of  (3.3)  is  0(c*  ||B||2).  Since  \p"  =  0  outside  a  finite 
set  and  J  n->  i  I  >  '4*  the  first  term  on  the  r.h.s.  of  (3.3)  is  bounded  by 

?  K 


M|o  -  1|  (I  sp  1  (I  tree))*8  =  0(| |S| |  \a  -  1|)  . 


Thus, 


|An|  =  0(e 2  ||B!r  ♦  |o  *  1|  I  |  S  |  | ) 


'l 

We  next  consider  A^,  in  particular  its  last  two  terms.  Since  z  sf  *  1  and 

E  yx  ip'  (yp  -  o. 


(3.4) 


n 


(o  -  1)  J  s[  yL  ip'(yi)/n  **(yj)  -  0  (|o  -  1|). 


i=l 


Ihibcr  shows  that 


(3.5)  l  s.t-CP)  (0*  (y  )  -  I;  ^'(y,))/K  <l>'  (y,)  =  OJi:  *  ||b||2). 
i=l  A  1  P 

Thus,  uniformly  on  the  set  |  |p|  |2  <  Kp,  |o  -  1  j  ;  Kn'\  |  |a|  |  «  1  wc  have 
from  (3.3)  -  (3.5) 

(3-6)  I  \  a-(4-.(B,o)  -  (p,o)  |  =  O.fc’V  ♦  pn  ~'5)  . 

j=l  J  J  J  P 

Another  Taylor  series  expansion  shows  that 

(3-7)  lB„l  '  IVlt('-0)  ‘  VltS’0)  *  C"l  *  C"2! 

<  Ml |o  -  1|  1 13|  |  ♦  pn' '■*  ♦  n'  i  |o  -  1|2}  , 

where 

-{2  E  yj  iKyj)  (y1))Cnl  =  2n''1  (o  -  1)  J  (y.  t^)  (y±)  -  E  yx  ^3  ^(y^) 

and 

{2  E  yx  iKyx)  !p*  Cy1)>c:n2  =  2  0  n‘ 2  £  ti(g)  ip(y±)  ^'(yJ  . 

i*l 

Since  =  flp(|o  -  1|)  and  =  0  ( (p/n) s)  ,  wc  obtain 

l*p+l(B,a)  -  ^(6,0)1  =  Op(pn",J)  . 

2  h  3  '< 

Since  (rp  )  >  (p  /n)  >  pn  \  wc  thus  obtain  (3.1).  Equation  (3.2)  follows 

from  (3.20)  of  Huber  (1973). 


Proof  of  Theorem  1.  The  proof  of  Proposition  1  makes  it  clear  that  we  need  to 
obtain  bounds  for  | A  |  and  | Bn |  uniformly  on  the  set  ||S||  <  Kp, 
jo  -  1 1  <■  Kn  2  and  |  |a|  |  =  1.  Rewrite 
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E  m*  Cy,)  |An  |  =  |  l  1 1 C i , B,o)  | 

A  n  i=l 
n 

l  (  SiliKoCy.  -  t.  (»)))  -  ip (y i ) ) 
i=l  I  1  11  1 

\  *  (a  -  1)  sA  yi  i|»'(yi) 

'  -  a  si  tA CP)  (ip*  (y±)  -  n  ip*  CyL) ) 

Let  I  be  the  indicator  function  and  let  -*-0,  n-1  ap  -*■  Then 
n 

lAnl  =  J  H(i,pfo)  j  I(-c  +  an  <  y.  <  c  -  an) 

j  *  I (yL  >  c  +  an)  ♦  I (y.  <  -c  -  an) 

(  .  ICC  -  a,  <yj  <  -c*.n)  ♦  Itc  -  an<Xi  <c  an) 

•  lAnl  *  An2  *  a„3  *  An4  *  As  I- 

For  notational  purposes,  define  d^  =  o(y^  -  t. (3)).  Then 
n 

Anl  "  Wi.S.ff)  K-c  +  an  <  >'i  <  c  '  an) 

x  {I  C-c  <  dt  <  c)  ♦  I  (Kb  |  >  c)}  *  . 

By  Proposition  1,  |A^  |  =  cKc^p).  Since  vp  is  Lipschitz  and  constant  outside 
a  finite  interval, 

lAnl^  -M  i^1  lsi  I { 1°  "  M  +  KiCP)  | )  I(-c  +  an  <  Yt  <  c  -  an  |di|  >  cj  . 
However,  since  |o  -  1|  <  Kn’  *  and  n*  an  -*•  0, 

l  (|o  -  1|  +  |t.(B)|)  I{|t.(3)|  >  a/ 2}  . 
i*l  A  11 

Now 

(3.8)  ^  Il|t.(3)|  >  an/2)  £  4p/an2 


The  same  bound  (3.10)  holds  for  lA^I  and  |A^|.  Noting  once  again  that  ij;  is 
Lipschitz  and  constant  outside  a  finite  interval. 


| }  I ( |yi  -  c |  <  an) 


where 


From  Lemma  1  of  Carroll  (1078),  provided  na 


This  gives 


The  bound  (3.12)  also  holds  for  |A  ,  |.  Thus 


The  same  bound  holds  for  IB  I.  Thus 

'  n 1 


9 

(3-14)  ||<KM)  *  nM)||  =  Op(*.'a  p(l  +  (nan2)'^)/an  ♦  (,.  npaj'*) 

=  t)  (r(p,n))  . 

P 

Equation  (3.14)  is  the  generalization  of  Huber's  (3.18).  As  he  shows,  for 
sufficiently  large  K,  on  the  set  ||p||2  <_  Kp,  |o  -  1 1  <_  Kn’\ 

(3.15)  |  |*(8,o)  -  (6,  (np)?i  (o  -  1))  1 1  <  r(p,n)  +  ^(Kp)^  . 

Thus,  if 

(3.16)  r(p,n)/pi  0  , 

Brouwer's  fixed  point  theorem  enables  us  to  conclude  that  <J>  has  a  zero  inside 
the  ball  ||(p,  (np)  1  (o  -  1))||  <  Kp.  Equation  (3.16)  is  true  if  (2.6)  is 
true.  The  rest  of  the  proof  parallels  that  of  Huber.  D 
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